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(54) Adaptive self repairing 
processor array 

(57) An adaptive self-repairing 
processor array comprises a 
plurality of identical processing 
cells, for example arranged in 
parallel orthogonal columns and 
rows to form a two-dimensional 
matrix, each of said cells in the 
array having logic means and a 
memory for storing a memory state. 
The first row of the cells in the 
array forms a parallel input to the 
array. The last row of said cells 
inthe array forms a parallel output 
from the array. The cells in the 
intermediate cells rows between the 
first and last rows are coupled to at 
least one cell in a previous cell row. 
The logic means in each cell 
computes a new data value based 
upon the input or inputs from such 
previous row cells and its present 
memory state. Each cell is further 
coupled to at least one cell in the 
subsequent row of cells. The 
computed new data value is 
provided as an output to the 
coupled cell or cells in the 
subsequent cell row. Each of the 
intermediate row cells are coupled 
to immediately-adjacent neighbor 
cells of the same row to supply the 
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new data value to these neighbor 
cells and correspondingly receive 
computed new data values from 
these same cells. The logic means 
in each cell compares the new data 
values received from such neighbor 
cells with its computed new value 
and accordingly updates its memory 
state based upon the results of the 
comparison. 
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SPECIFICATION 

Adaptive self-repairing processor array 

5 Background of the Invention 5 
This invention relates to digital parallel processors or processor arrays of the type having a two- 
dimensional matrix of substantially-identical interconnected cells adapted to receive signals from 
other cells in the matrix to perform sequentially transformational operations on a plurality of 
input signals to produce an output based upon such operations. Thus, the output of any cell 

10 under consideration is dependent upon the results of operations performed by neighboring cells, 10 
which results are received as inputs by such a cell. 

There are many examples of different types of parallel processors or processor arrays in the 
prior art. Over the years, in particular, dating back into the 1950's, many studies have been 
made by scientists and researchers concerning the properties of cell arrays and cell masses. 

1 5 Much of this research pertained to studies with intent on understanding and duplicating neuron 1 5 
activity of the human brain, particularly in connection with patterns of learning and recognition. 
See, for example, the articles of R.L Beurle, "Properties of a Mass of Cells Capable of 
Regenerating Pulses", Royal Society of London Philosophical Transactions, Series B: Biological 
Sciences, Vol. 240 (B.669) pp. 8-94 (1956); D.R. Smith et at t "Maintained Activity in Neural 

20 Nets", ACM, 1969; and G.M. Edelman et al, "Selective Networks Capable of Representative 20 
Transformations Limited Generalizations, and Associated Memory", Proceedings of National 
Academy of Science, U.S.A., Vol. 79, p.p. 2091-2095, March, 1982. 

From these early studies, many new developments have arisen for parallel processing 
architecture and design wherein each cell structure in a processor cell array has its individual 

25 logic capability for processing data as well as limited memory or storage capacity. These 25 
developments were, in part, moved forward by the combination of (1) a need for processing, in 
a timely manner, a myriad of input data and (2) the advent of large scale integration (LSI) and, 
later, very large scale integration (VLSI). Examples in the literature of such developments are 
W.H. Kautz, "Cellular Logic-in-Memory Arrays", IEEE Transactions on Computers, pp. 

30 1566-1569, December, 1971; and D.H. Lawrie, "Access & Alignment of Data in An Array 30 
Processor", IEEE Transactions on Computers, Vol. C-24, No. 12, pp. 1 145-1 155, December, 
1975. 

One of the most fundamentally-referred to examples of a digital parallel processor in the 
patent literature is US 3,106,698, comprising a two-dimensional matrix of identical processing 

35 elements or cells having a logic and storage capability. Each cell is connected to a plurality of 35 
neighboring cells and input data or signals may be introduced directly into each cell from an 
equivalent cell via an input array. Processing in each cell is accomplished under the control of a 
master control which issues general orders to all of the cells to permit simultaneous processing 
of the data in each cell and transfer information between cells through multiplexer links. A series 

40 of transformations is performed on the input data by the cells to arrive at an output matrix. 40 
Other examples of such parallel processor arrays under the control of a master control, such as a 
central processor or controller, are U.S. Patents 4,065,808; 4,215,401; 4,270,169 and 
4,395,699. 

Some of the best known applications for parallel processors or processor arrays is automatic 
45 recognition, analysis, digitization and/or classification of patterns, and the process of pictorial 45 
information or alphanumeric character type information. An example of such a processor is 
disclosed in U.S. Patent 4,060,71 3 relating to analysis of images by comparison of values of 
image elements with neighboring image elements in a two-dimensional processing field. U.S. 
Patent 4,384,273 discloses an orthogonal array of interconnected array cells with time warping 
50 signal recognition for matching signal patterns. Another patent is above-mentioned U.S. Patent 50 
4,395,699 relating to an image analyzer system having a processor array for analyzing groups 
of neighborhood pixel values and selectively transforming the pixel values as a result of such 
group analysis. 

Today, parallel computation holds promises in many fields, ranging from numerical methods 
55 and robotics, to cognitive processes such as vision and speech understanding. Recent advances 55 
in VLSI technology have made it possible to construct concurrent processor arrays based on a 
regular array of locally-connected elements or cells. Besides their useful applications, such 
processor arrays have the potential of exhibiting behavior characterized by self-organization, 
learning, and recognition. 

60 Because of the large number of array cells and associated control means, these arrays are 60 
relatively complex in architecture and design. While prior processor arrays have aimed at 
simplifying these processors, it is a difficult task, particularly where accuracy is a paramount 
parameter and constraint desired in the processing operation carried out by the array cells. 
We have discovered that a processor array may be designed to have a learning capability 

65 sufficient for utilization in the above-mentioned applications while not being constrained to a 65 
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high degree of accuracy, i.e., providing an output immune to errors that may occur in the one or 
several individual cells of the array. We refer to this immunity as "self-repairing". 

Summary of the Invention 

5 According to this invention, an adaptive self-repairing processor array is designed to have 5 
adaptive behavior in parallel array cells which can be implemented with the current VLSI 
technology. Features such as local connection, few wires and a regular lattice structure, make 
them ideally suited for implementation on single VLSI chips. Moreover, their high degree of 
concurrency and programmability provide an efficient method for useful array properties, which 

10 include learning, pattern recognition and associative content addressable memory. The novel 10 
adaptive processor array of this invention exhibits a self-repairing mechanism which is based on 
the existence of stable attractors in the overall array dynamical behavior, which implies a 
conceptual departure from the usual multiplexing thinking and associated majority rule schemes. 
The adaptive self-repairing processor array of this invention comprises a plurality of identical 

1 5 processing cells arranged in parallel orthogonal columns and rows to form a two-dimensional 1 5 
matrix wherein the first row of cells in the array forms a parallel signal input to the array. Each 
cell in the first row receives an input signal from a signal source. Subsequent rows of the array 
cells are coupled to immediate neighborhood cells in either or both orthogonal and diagonal 
directions relative to the parallel orthogonal rows and columns of the array matrix. Logic means 

20 in each of cells, therefore, will receive one or more inputs from one or more orthogonally or 20 
diagonally connected cells in the previous cell row, and from adjacent cells in the same row. The 
logic means provides computing, comparison analysis and updating of the input values received 
with the data value in the memory of a cell to provide a new memory data value and a new 
output data value. The new output data value is provided as an output to orthogonally and/or 

25 diagonally connected cells in a subsequent cell row and to adjacent cells in the same row for the 25 
purpose of comparison analysis. 

in particular practice, the connected inputs to a cell under consideration, received from a 
previous row of cells, are employed in a computation to provide a new cell value based upon 
established algorithms or rules. This computation includes the employment of the present 

30 memory state of the cell. The new value obtained is compared with the other new values 30 
obtained by the two adjacent neighbor cells of the same row to determine if the new value of 
the cell under consideration is no different, higher or lower than either of the new values of 
either of the adjacent row cells. If the value compares to be the highest, the value of the 
memory state of the cell under consideration is increased by one. if the value compares to be 

35 the lowest, the value of the memory state of the cell under consideration is decreased by one. 35 
Otherwise, the memory state remains unchanged, i.e., if the value is neither higher or lower, no 
memory state change is made. This processing continues (1) with the computed new data 
values set to remain in a prescribed range of saturation limits and (2) as long as there are input 
signals present and until the last of such signals propagates to the last row of the cells in the 

40 array. 40 
Other objects and attainments together with a fuller understanding of the invention will 
become apparent and appreciated by referring to the following description and claims taken in 
conjunction with the accompanying drawings; in which: 



45 Brief Description of the Drawings 45 
Figure 1 is an example of interconnections between cells in an adaptive processor array 
according to the present invention; 

Figures 2A, 2B and 2C are pictorial illustrations of the three principal functions performed by 
the cells in the array of Fig. 1, which functions are, respectively, compute, compare and update, 
50 and output in accordance with the algorithms and rules used in the processing operation of the 50 
array; 

Figure 3 is a logic flow diagram for the rules and algorithms used in the processing operation 
of the array; 

Figure 4 is another example of interconnections between cells in an adaptive processor array 
55 according to the present invention for the purpose of demonstrating the stroboscope sampling of 55 
the adaptive processor array of this invention; 

Figure 5 is a graphic representation of the distance (differences) between successive sets of 
outputs of an array of the present invention as a function of time to illustrate the self-repair 
aspect of the instant invention; 
60 Figure 6 is a graphic representation of the percent of data signal that is saturated as a 60 
function of time; 

Figure 7 is a circuit representation that may be employed for the array cells of the present 
invention, and 

Figure 8 is an illustration of the processing operation of the array under the rules and 
65 algorithms expressed in this invention. 65 
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Description of Preferred Embodiments 

Reference is made to Fig. 1 illustrating an example of the adaptive processor array 10 of the 

present invention. The array 10 comprises a plurality of interconnected identical processing cells 
5 12 arranged in parallel orthogonal rows, m, and columns, n. In the simple representation 5 

shown, adjacent cells in a row are connected to each other and cells from a previous row are 

connected to diagonally-positioned cells in a subsequent row. 

Fig. 1 represents only a portion of array 10. The illustration relates to a unit cell ij of the array 

and its relationship to immediately-adjacent neighborhood cells in immediately-adjacent columns 
10 and rows of the array. Array 10 could extended by many more columns and rows, as indicated 10 

in Fig. 1 horizontal dotted lines and the vertical rows of dots therein, to form large matrices, for 

example, 20 cells by 32 cells, i.e., 20 rows and 32 columns totaling 640 cells. The array 

configuration may be square or rectangular. The size and shape of the array depends upon the 

number of inputs needed and the type of application that is desired. 
1 5 The central cell 1 2 of array 1 0 is designated eel! ij in row i and column j. Thus, the top row is 15 

row i - 1 followed by row i and thence row i + 1 . By the same token, the left column of the 

array 1 0 is column j - 1 , followed by column j and thence column j + 1 . 
Cell 12 at cell position i — 1j — 1 in Fig. 1 is connected by line 14 to adjacent row cell i — 1j 

and this latter cell is connected by line 1 6 to cell i — 1 j — 1 . This same type of cross connection 
20 arrangement is also true between the row cells of all rows i — 1,1 and i + 1 as indicated by the 20 

same numerically identified lines 14 and 16. 

As above indicated cells 1 2 of a previous row are connected to cells 12 of a subsequent row 

by means of diagonal lines 1 8 and 20. Thus, for example, cell ij in row i is diagonally 

connected to cell i + 1j — 1 in the subsequent row i + 1 by line 18 and to cell i + 1j + 1 of 
25 subsequent row i + 1. These lines 18 and 20 represent output lines from cell ij and output line 25 

1 8 is one of two inputs to cell i 4- 1 j — 1 and output line 20 is the other of two inputs to cell 

i 4- 1j + 1 . By the same token, diagonal line 20 from cell i — 1j — 1 in previous row i — 1 is one 

input to cell ij in row i and diagonal line 18 from cell i — 1j 4- 1 of row i — 1 is the other input to 

cell ij in row i. 

30 It should be noted at this point that the configuration of cell connection shown in Fig. 1 is not 30 
the only possible configuration within the basic concept of this invention. For example, the 
diagonally-connected lines 18 and 20 may be not employed and connections could be with a 
column cell in a previous row and in a subsequent row as illustrated by dotted lines 22. A 
further configuration would be the inclusion of lines 22 in the embodiment as shown in Fig. 1 . 

35 Cell row connections are particularly important in the particular application of the rules and 35 
algorithms of the present invention in connection with image enhancement, image recognition, 
edge recognition, etc. 

As an example of the above, Fig. 4 illustrates a 5 cell by and 8 cell array 30 illustrating single 
integer inputs and outputs between aligned column cells in adjacent rows of the array connected 

40 by lines 22. 40 
In the partial representation of Fig. 1, top row represents, for the sake of simplicity in 
illustration and explanation, the input row to the array 12 is via input lines 24 to each of the, 
cells of the first row or row 1 while the last or output row of the array is via output lines 26 
from each of the cells or row m. Of course, in actual practice, there would be additional rows m 

45 of cells between these termination rows and rows i — 1 , I and i + 1 . The side edges or the first 45 
and last columns, respectively 1 and n, of the array are not employed in the processing 
operation of the array and form side boundaries for the array between the input row 1 and the 
output row m. 

Each cell 12 receives data values from the inputs of its connected neighboring cell in the 

50 same row and from the preceding row. The inputs on lines 18 and 20 from the preceding row 50 
represents two integer inputs I, and l 2 , as shown in Fig. 2A. In addition to data values received 
through these connections, each ceil, which is itself a processor, has an adjustable internal 
memory state, M, which allows a cell to adapt to its local environment, i.e., its resultant data 
value is either changed or not changed dependent upon the data values received as inputs from 

55 neighboring cells. 55 
Thus, for a particular implementation of array 1 0 in Fig. 1 with m rows and n columns, each 
cell 12 is provided with two integer inputs I, and l 2 and a single integer output, 0. All of the 
data values to travel through the array are further constrained to lie between two limits 
represented by integers S mm and S ma , with S min <S ma)( and wherein S is the saturation limit 

60 integer, maximum and minimum. This constraint eliminates the possibility of data overflow and, 60 
more importantly, provides a high degree of reliability to the array, as will be discussed in 
further detail below. Considered the symmetric case in which S mm = — S max and chose S max =15. 
The internal state of each cell is represented by a single small integer. 

The local computation rules or algorithms for each cell enhance differences in the data values, 

65 with a saturation process maintaining the values within the specified range. 65 
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Specifically, 1 ct M^k) of the memory value between a fixed saturation range, M min and M max 
contained in a cell located in the i th row and j m column after the k th time step. Let I'^k) and 
i (2) ij(k) be the input values to this element and O^k) be the output. Fig. 2 is useful in the 
explanation of the steps by which new data values and memory values are computed. Fig. 2A 

5 re p resen ts the computation step for data value O^k) based upon values I, and i 2 received on 5 
lines 18 and 20 of cell ij from diagonally connected cells from the previous row i - 1. Fig. 2B 
illustrates the comparison step wherein the computed values are forwarded to neighbor cells of 
the same row i for comparison with the memory data value of each of its adjacent neighbor cells 
ij — 1 and ij + 1, and then the memory value, M ijf is updated according to the comparison result 

10 with the computed data values of neighbor cells. Fig. 2C illustrates the updated memory value, 10 
M'i and the new data value, O ijf which is provided as a single integer output on lines 18 and 
20. This processing is further illustrated by the flow diagram of Fig. 4. 

A general explanation will now be made of cell processing before detail description of the 
algorithms and rules. 

1 5 First, consider that the four saturation limits for both S mjn and S max ; M mjn and M max have been 1 5 
set to predetermined values. Referring to Fig. 4, input signals, each representative of particular 
data values, are supplied to the first row of array cells 1 from a data source via input lines 24. 

Next, according to the compute step of Fig. 2A, an output is computed in a cell according to 
the input value differences between the data values I, and l^ on lines 18 and 20 obtained from 

20 cells in the previous row. Then, this computed value is multiplied with the present memory 20 
value to produce a new data value, O ir According to Fig. 2B, this new value is then compared 
with the computed new value obtained in immediately adjacent row cells. This is accomplished 
through the horizontal connections with adjacent cells in the same row to thereafter adjust the 
internal state of the cell memory, M IJf based on a neighbor's output. If the comparison indicates 

25 no change or "NO", then the present data value in the cell is maintained and remains 25 
unchanged. However, if the value compares to be highest or lowest, then the present 
accumulated value in the ceil memory is updated to the new value, either higher or lower. The 
internal memory value or state of the cell memory, M, Jf is accordingly modified to and the 
new data value, 0,,, is dispatched as an output signal to one or more neighborhood array cells, 

30 which, in the case of Fig. 1, are output lines 18 and 20 from each cell 1 2. 30 
Having completed this output, a full cycle of cell processing in a time step, k has been 
achieved. If the last series of inputs to the cell array have not been received, this cycle is 
repeated until the last row of input signals have propagated to the last row m of the array, at 
which point the processing is complete and the data values within the above mentioned 

35 saturation limits are presented as a line output via output lines 26, the parallel output signal of 35 
the array 1 2, 

Thus, at each time step, k, the new output of a cell 1 2 is computed by the equation 

O n (k + 1 ) - max[S min , min[S maK , M„(k) . (1 "K(k) - l< 2 >*< k »D < 1 > 

40 40 

which, except for the saturation S mm or S max , just multiplies the difference between the inputs I, 

and l 2 by the value stored in the cell memory, M (J . Note that the output is a nonlinear function of 
the inputs because of the saturation limits. 

The connections between adjacent cells in the same row is determined by specifying which 
45 output is connected to each input. This is defined by the relations: 45 

I^ 11 (k) = O t _ 1 . i _ 1 (k) (2a) 
P> 1J (k)-0,_ 1 , J+t (k) (2b) 

50 for 1<i<m and 1<j<n where m and n are predetermined row and column values. These 50 
connections cause the data to flow through the array at a rate of one row per time step, k. The 
external input signal to the array at step k is denoted by S(k), and R(k) is the resulting output 
signal. The boundaries of the array are specified by 

55 0 03 (k) = S,<k) (3a) 55 

O mi (k) = R,(k) (3b) 
and 0 lo (k) = 0, n + 1 (k) = 0 (3c) 

for the top, bottom and side edges respectively. 

60 In addition to this compute process, which basically involves the flow of data through the qq 
array, there is an adaptation mechanism which modifies the memory values M,,. Specifically, the 
output of the cell ij is compared to the outputs of its neighbors to the left and right, as shown in 
Figs. 2(B) and (C). If the output of cell ij is greater or smaller than the other two, the value of 
is respectively increased or decreased by one, subject to the restriction that the value remain in 

65 a fixed range [M mm , M ma J. Otherwise M tJ is not changed. For example, the range values may be 55 
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M min = 1 and M max = 4. This provides, for example, local adaptation to edges by adjusting the 
memory value at points where the data are changing rapidly. 

As previously noted, this comparison process requires horizontal connections with neighbor 
row cells within each row. Thus, by separating the adaptive process from the flow of data 
5 through array, the adapted array can be analyzed by sending a series of parallel input signals 5 
through the array without changing the memory values. 

The general behavior of such a processor array may be very complicated. However, the 
number of independent configurations that must be considered is greatly reduced by studying 
the output from the last row, and considering as identical all states of the array that produce the 
10 same output. To provide a quantitative measure of "unsupervised learning" in the array, a 10 
stroboscopic technique is employed, which is diagramatically illustrated in Fig. 4. By presenting 
a periodic string of inputs and computing the distance (differences) between corresponding sets 
of sampled outputs, one is able to study dynamical changes in the array while it is adapting to 
the sequence of input signals per time steps, k. The various inputs are piplined through the 
1 5 array without the necessity of direct access to the internal memory state, M of the array cells. 1 5 

In the adaptive mode of operation, i.e. when the internal memory state of each cell 12 is 
modified based on the data values it receives from its neighbor cells, the periodic sampling 
described above rapidly converges to a particular set of patterns. A quantitiaive measure of this 
convergence is given by the maximum distance (differences) between corresponding outputs in 
20 successive periods of the input sequence. Since a particular signal requires m time steps to 20 
reach the output the signal vector entering the array at step k, S(k), will produce a result at step 
m + k, fl(m + k). Let P be the input period so that S(k + P) = S(k) for all k. The output distance 
for each period is computed according to 

25 d(t)=*max ||R(m + k + P) - /?(m + k)|| (4) 25 

w 

where k ranges over the set {tP + 1 , tP + 2 (t + 1 )P}, i.e. the times at which the t th period 

of the input signal enters the array. Convergence to a fixed point, which is signaled by d(t) = 0, 

30 implies that the outputs are the same for successive input periods. 30 
Fig. 5 shows the results of an experiment performed on a representative array consisting of 
64 cells arranged in a square lattice which was subjected to a periodic, pipelined input 
consisting of 4 patterns (P = 4) chosen at random. The saturation values were chosen to be 
S max = — S min = 1 5. As shown in Fig. 5, curve 34 represents the changing state of the array and 

35 stabilizes at point 32 in a relatively short time. To be noted is that there are about 5 periods up 35 
to the position of arrow 38. In the adapted regime, the stroboscopically sampled state of the 
array consists of a complicated configuration of memory values, M (J , which are illustrated in the 
upper insert in Fig. 4 entitled "Array Before Upset". 

In both inserts of Fig. 4, the upper insert: "Array Before Upset" and the lower insert: "Upset 

40 Array", the asterisks ( # ) represent the value of 4 and the dots (.) represent the value of 1 . The 40 
other values, 2 and 3, are shown at the points in the array as indicated. The use of these 
symbols is solely for the purpose of not cluttering the insert representation so that the inserts are 
easier to follow and comprehend. 

The fixed points of data values after point 32 possess the strong property of being attractive, 

45 i.e. departures from them tend to relax back to originally obtained values as in dissipative 45 
dynamical systems. This is caused by the saturation used in the computation rules of equations 
(1) and (2), which prevents unbounded growth of errors through processing by the array. This 
process is illustrated by plotting the fraction of data values that are saturated, i.e. equal to either 
S min or S max , as a particular input moves through each row of the array. This is illustrated in Fig. 

50 6 wherein the percents of the input signals, l/l max , that are saturated is plotted over time. 50 
It should be noted that this does not imply that the internal memory values are saturated. Fig. 
6 shows this fraction for the square array with 64 cells. Note that the data reach saturation 
more rapidly as the cells in the array adapt to values based upon the parallel input signal or set 
of parallel input signals. 

55 The existence of stable attractors for these computing structures provides a novel mechanism 55 
of self-repair during the adaptation process of the array following the algorithms and rules 
provided in the previously-mentioned equations. The dynamics of the array are such that it 
causes small fluctuations in either new data values or memory values to relax toward the 
attractive fixed points. It should pointed out that this general method of self-repair is very 

60 different from the standard techniques used for reliable computing. The latter are based on 60 
multiplexing schemes with majority rules and require an enormous amount of hardware per 
operation. The techniques herein disclosed, however, use instead the stable collective modes of 
the adaptive processor array. 

Errors can occur during the adaptive process either while the array is changing or after it has 

65 converged. Such errors may be introduced by randomly modifying some of the memory data 65 
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values M r , and then allowing the array processing to proceed as before or by permanently 
freezina the state of some of the cells as well as their outputs. 

The changed values for the example of Fig. 5 are shown in the bottom nsert, Up^ArraV 
wherein the circled numerical values represent changes to the memory values, M,, as compared 
5 wlthTneir previous values, for the same cell locations illustrated m the upper msert. These upset 
Sues are inserted in the respectively designated cells at the time indicated by arrow 38 in Fig. 
5 Any changes produced at the output are recorded and are a measure of the behavior of the 
ar'my It is to be noted that an error that occurs inside the array but .s repared before reaching 
the output row m of cells will never be noticed. Even for fairly small arrays, it has been found 
10 tha the adaptive self-repairing process is very insensitive to such changes, with rap.c I conver- 
qence back to the overall previous memory state. This is .llustrated .n Fig. 5 by the curve 36, 
which shows the distance (differences), d, function verses time, t, as the array adapts to its 
oSalvaTues after the insertion of the five upset values at point 38. By distance we mean the 
Serences in values between the respective outputs of ' Array Before Upset and the respec j 
1 5 outouts after "Upset Array" based upon the same parallel input s.gna or set (series) of parallel 
inout sianals After the processing converged, the five cell memory values, which were then 
mod fied caused a change at theoutput which was randomly corrected. In other instances, the 
error recovery has been found to be so rapid that the output row m of cells never changed. 
Typically a change in 20% of the cell memory values may be ' healed via processing 
20 operation by the array using the algorithms and rules herein defined. 

These attractive fixed points produce recognition processes wh.ch, unlike ) those in ^ g'tal 
electronic filters, are nonlinear due to saturation in the local computation rules or algor thms _By 
fixing the values of the memory states of the cells and then sending a series of inputs through 
the array in any given order, one can determine which learned inputs produced different 
25 outputs Theseprocesses map many different input patterns into each output and in general 25 
the output of the array is insensitive to small variations in any or some of the inputs. Thus small 
dltortio P ns, as measured by their distance, of the learned inputs still produce the same outputs. 
Said another way, the processing operation is immune to small changes in inpul . values or 
memory state values during processing whereby the same desired outputs will still be produced. 
30 AlS by using each output as an address in a data base, for example, the array can be made 30 
into a flexible content addressable memory. . 

The motion of the data values deep within the adaptive processor array in the recognition 
mode may be analyzed in a recursive fashion. Since, in this particular case, the data values 
become saturated, and the saturation values are symmetric, there are three possible values, 
35 namelv OS and - S max which can be considered as the closed set {1 ,0, - 1) . *° 
The dynamics can then be studied by assuming that as data values move down from one row 
of cells to the next, the distribution of ones and zeros within a row is random. Within this 
"random phase approximation", suppose that + 1 and - 1 each appear in a given row with 
probability p, and 0 appears with probability q so that 2p + p - 1 . Consider a cell in row. + 2 
40 and its parents in rows i + 1 and i. The three parents in row . produce outputs 0,. J, 
respectively. These outputs are fed into two cells in row . + 1 which in urn produce outputs O , 
and 0', Next the output O" of the element in row i + 2 is computed. In this case there are 
3 3 = 27 possible combinations of the three outputs of row i. Since the data values are assumed 
to be independent of each other, the probability that the final output 0" w.l be zero or ± 1 can 
45 be computed. The probabilities of obtaining 0 or ±1 in row i ± 2, q and p . given the 
probabilities in row i, are then determined by the following recursion relations: 

q' = (1 - q - q* + 5q 3 )/4 

p' = (1-q')/2 50 

50 In a deep array, the asymptotic behavior is determined by the stable fixed points of these 
recursion relations, which are q = 1 /5 and p = 2/5. Thus zeros will be comparatively rare and 
most of the output will consist of ± 1 - The testing of this behavior by sending many input 
signals through various sizes of arrays have resulted in the experience that zeros seldom appear 
55 in the saturated outputs of the array. A quantitative comparison w.ll require the consideration of 
correlations produced by additional rows which tend to make the appearance of zeros deep in 
the matrix of the array even less likely. „ Woi 

The processing arrays described above consist of identical computing cells with short local 
connections arranged in an orthogonal lattice. Also, input/output is performed only at the 
60 edges, thus minimizing the length of connection leads. As such, they can be readily w 
implemented in hardware. Such an implementation could be very fast since computation is done 
bv all cells in a concurrent manner. However, the primary limitation will usually be set by the 
rate at which input signals can be delivered to the array and outputs removed from the array. 
While many conventional circuit arrangements may be devised to perform the functions ot 
gs 2 and 3 Fig 7 illustrates one possible arrangement for the structure of cell 12. Inputs I, bo 
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and l 2 from diagonally connected cells in the previous row of the array are supplied to adder 42 
with input l 2 being inverted via inverter 40. Adder 42 provides an output representative of the 
difference between inputs I, and l 2 as an input to the multiplier 44. Beside the input from adder 
42, multiplier 44 also has an input from the cell internal memory 46 for multiplying the data 
5 value present in memory M with the value received from adder 42. The outputs from multiplier 5 
44 on lines 48 and 50 represent the result of the compute step of Fig. 2A, i.e., the result of 
equation (1) within the limits of S max and S min . Output, 0^ on line 50 is supplied on lines 18 and 
20 to diagonally connected cells in the next row of the array. This output is also supplied to 
comparator 52 bia line 48. Comparator 52 first compares the value represented by the signal on 

10 line 48 with the new data values represented by each of the signals on input line 14 from the 10 
row cell to the left of the cell under consideration and on input line 1 6 from the row cell to the 
right of the cell under consideration. 

As indicated in connection with the description of Fig. 3, if the value compared relative to 
either one of the inputs is the same, there is no change and no update value. However, if the 

15 new value on line 48 compares to be either higher or lower than both of the representative 1 5 

values on input lines 14 and 16, within the saturation limits M max and M min of memory 46, then 
the value of memory 46 will be updated by an increase of one (if the data value on line 48 is 
greater than either one of the values on input lines 14 and 1 6) or will be updated by a decrease 
of one (if the data value signal on line 48 is less than either one of the values on input lines 14 

20 and 16). The updated memory value at memory 46 is now ready for the next cycle of operation 20 
as an input to multiplier 44. 

The output lines 14 and 1 6 from comparator 52 provide for the transfer of the new data 
value signal on line 48 to be supplied respectively to the row cell to the right of and to the left 
of the cell under consideration. 

25 Fig. 8 represents a specific example illustrating the processing operation in accordance with 25 
the algorithms and rules defined herein. Assume for the purpose of the example that the cell 
under consideration is cell ij and its row cells ij — 1 and ij + 1 . Assume further that the present 
memory values for cells ij - 1 ; ij and ij + 1 are respectively 2, 1 and 2. Assume further that 
updated values received from the previous row as inputs l t and l 2 are respectively 5 and 3. S max 

30 is 1 5 and S min is - 1 5. M max is 5 and M mm is 1 . 30 
During the compute step, the difference of the values ^ and l 2 is taken and multiplied via 
multiplier 44 by the value in memory M of cell ij. This results in 



1 . (5 - 3) = 2 

35 35 
The new value 2 is then supplied as input to cell ij — 1 via output line 1 6, and to cell i, j + 1 
via output line 14 for comparison with the new value obtained at those cells. Also, the new 
value 2 at cell ij is placed as an output, O iJ# on its output lines 18 and 20 to connected cells in 
the next row of arrays cells. 

40 Now, assume that the new value in cell ij — 1 was 5 and the new value in cell ij + 1 was 3, 40 
both of these values being calculated based upon inputs \, and l 2 received from connected cells 
in the previous row of the cell array as multiplied with their accumulated memory value. The 
new value of cell ij of 2 is then compared with the new value 5 of cell ij — 1 and the new value 
3 of cell i, j + 1 . In both cases, the value of 0 (j = 2 proves to be lower. To be noted is that if 

45 one of the compared values with a neighbor row cell was higher and the other lower, the 45 
resultant comparison with both would result in no change to the memory state of cell ij. 

Since the comparison, however, proves to be that cell ij has the lowest value, its memory 
value is to be lowered by 1 . However, the memory of cell ij is already at the lower limit value of 
M m(n = 1 . Therefore, the memory value of cell ij will remain at 1 . 

50 50 
CLAIMS 

1 . An adaptive self-repairing processor array comprising a plurality of identical processing 
cells arranged in parallel orthogonal columns and rows to form a two-dimensional matrix, each 
of said cells in said array having logic means and a memory for storing a memory state, the first 

55 row of said cells in the array forming a parallel input to the array, the last row of said cells in the 55 
array forming a parallel output from the array, the cells in the intermediate cell rows between 
said first and last rows coupled to at least one cell in a previous cell row, said logic means in 
each cell to compute a new data value based upon said input and its present memory state, said 
each cell coupled to at least one cell in a subsequent cell row, said new data value provided as 

60 an output to said subsequent cell row, each of said intermediate row cells coupled to 60 
immediately-adjacent neighbor cells of the same row to supply said new data value to said 
neighbor cells and correspondingly receive new data values from said neighbor cells, said logic 
means in each cell to compare the new data values received from said neighbor cells with its 
computed new data value and accordingly update its memory state based upon the results of 

65 said comparison. 65 
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2. The adaptive self-repairing processor array of claim 1 wherein the updating of said 
memory state is accomplished only within a set range of values. 

3. The adaptive self-repairing processor array of claim 1 wherein the values provided as 

5 output from said cells are accomplished only within a set range of values. 5 

4. An adaptive self-repairing processor processor array comprising 

a plurality of identical processing cells arranged in parallel orthogonal columns and rows to 
form a two-dimensional matrix, 

the first row of said cells in the array forming a parallel input to the array, each cell of said 
10 first row adapted to receive an input signal from a signal source, 10 

subsequent rows of said cells coupled to immediate neighborhood cells in both orthogonal 
and diagonal directions relative to said orthogonal rows and columns, 

means in each of said cells to receive an input signal from said coupled cells in a previous cell 
row and from coupled neighbor cells in the same cell row, 
1 5 means in each of said cells to transmit an output signal to coupled cells in a subsequent cell 1 5 
row and to coupled adjacent cells in the same cell row, 

memory means in each cell to store a data value therein, 

logic means to perform simultaneous iterative calculations in the cells of each row based upon 
said input signals wherein the cells of each cell row calculate new values based upon said input 
20 signals and its present memory value and compare the new value with new values attained by 20 
said coupled adjacent cells, 

means to update the memory value in each of said cells to store said new value if the new 
value is different from the present memory value, 

the last row of said cells in the array forming a parallel output from the array, said parallel 
25 output representative of a corresponding enhancement of the original signal source parallel input 25 
of said array regardless of any inappropriate changes to the instantaneous value of one or more 
of said array cells due to an abnormality or malfunction in any such affected array cells. 

5. The adaptive self-repairing processor array of claim 4 wherein said cells further include 
means in each of said cells to inhibit a change in said present memory value in a cell when 

30 such value has reached a predetermined limit. 30 

6. A method of parallel processing of a plurality of input signals from a source, representa- 
tive of a wave of data, to provide an enhancement to the values of said data wave based upon 
the difference in signal values between adjacent input signals of the data wave comprising the 
steps of 

35 extending said input signals in parallel fashion through an orthogonal array of processor cells 35 
wherein cell rows are connected to some neighborhood cells of a previous cell row and to some 
neighborhood cells of a subsequent cell row and to some neighborhood cells of the same cell 
row and characterized in that said method relative to an observed cell in each cell row further 
comprises the steps of: 

40 computing a new data value in the observed cell at least one input from a cell in a previous 40 
cell row, 

comparing the new data value of of the observed cell with the new data value of at least one 
adjacent neighbor row cell, 

updating the present data value of the observed cell to the new value if the new data value is 
45 the greater or lesser of the compared new value of at least one adjacent neighbor row cell, 45 

maintaining the present data value of the observed cell if the new data value is the same or 
not the greater or lesser of the compared new value of said at least one adjacent neighbor row 
cell, 

outputting the new data value of the observed cell to at least one cell in a subsequent cell 
50 row. 50 

7. The method of claim 6 including the step of inhibiting any further change in the present 
value of the observed cell if the new data value is greater or smaller than a predetermined range 
of values. 
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